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This  paper  generalizes  Malvar-Coifman-Meyer  (MCM)  wavelets  by  extending  the  choice  of 
beO  functions.  We  dispense  with  the  orthonormality  of  MCM  wavelets  to  produce  a  family 
of  smooth  local  trigonometric  bases  that  efficiently  compress  trigonometric  functions.  Any 
such  bads  is,  in  general,  not  orthogonal,  but  any  element  of  the  dual  basis  differs  from  the 
corresponding  element  of  the  ori^al  basis  only  by  the  shape  of  the  bell.  Furthermore,  in 
our  scheme  the  bell  functions  are  bounded  by  1  and  the  dual  bell  functions  are  bounded 
by  (2^^^  +  l)/2  »  1.2.  These  bounds  ensure  the  numerical  stability  of  the  forward  and 
the  inverse  transformations  in  these  bases.  Numerical  examples  demonstrate  that  in  many 
cases  the  proposed  bases  provide  substantially  better  (up  to  a  factor  of  two)  compression 
than  the  standard  MCM  wavelets. 
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1.  Introduction 


The  problem  of  compression  of  digital  data  by  means  of  transform  coding  has  been  attracting 
an  increasing  amount  of  interest  during  the  last  decade  both  in  signal  processing  (see,  for 
example,  [12],  [17])  and  numerical  analysis  (see,  for  example,  [2],  [4]).  This  type  of  data 
compression  usually  involves  approximating  (with  a  speciiied  error)  a  function  defined  in  its 
domain  at  n  points  by  a  linear  combination  of  m  C  n  elements  of  an  appropriately  chosen 
basis.  In  particular,  efficient  compression  of  trigonometric  functions  of  the  form 

/(*)  =  cos(t*;is  +  a)  ( 1 ) 

where  u  and  a  are  arbitrary  constants,  is  a  problem  of  significant  importance.  The  interest  in 
this  problem  is  stimulated  by  the  fact  that  in  many  areas  of  signal  processing  and  numerical 
analysis  one  often  encounters  functions  c  €  L\ti)  whose  domain  can  be  divided  into  a  relatively 
small  number  of  segments  /,  in  such  a  way  that 

c(*)  =  S  cos(<4*  +  oi)  +  «i(®)  for  all  X  €  Ij,  (2) 

n=:0 

where  A^,  and  o:^  are  real  and  independent  of  x,  Mj  »  1,  and  max|ey(x)|/max  4;^  <  1. 

{n}  I  I 

A  powerful  tool  for  the  compression  of  functions  (1)  are  orthonormal  local  trigonometric 
bases  discovered  by  Malvar  [14]  and  Coifinan  and  Meyer  [8].  These  bases  are  a  generalization 
of  the  well  known  trigonometric  bases  on  [0, 1]  (see,  for  example.  Chap.  2  of  Tolstov  [19]),  in 
the  sense  that  any  element  of  these  bases  is  a  product  of  a  function  b,  that  has  a  compact 
support,  and  an  appropriate  trigonometric  function  (see  Subsection  2.1  for  more  details)  .  We 
wQl  refer  to  such  bases  as  Malvar-Coifman-Meyer  (MCM)  hoses  or  MCM  wavelets. 

The  principal  goal  of  this  paper  is  to  Introduce  a  family  of  non-orthonormal  bases  that 
provide  an  efficient  compression  of  functions  (1),  and  bases  dual  to  them.  These  objects  are 
dosely  related  to  MCM  wavelets:  any  element  of  a  basis  is  a  product  of  a  compactly  supported 
function  6  and  a  trigonometric  function,  while  the  corresponding  element  of  the  dual  basis  is  a 
product  of  a  compactly  supported  function  6  (uniquely  determined  by  the  function  h)  and  the 
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same  trigonometric  function.  Moreover,  the  functions  b  and  b  can  be  chosen  in  such  a  manner 
that  for  ail  X  €  R, 


0  <  6(x)  <  1, 

(3) 

0<6(x)<(2*/2+1)/2«1.2, 

(4) 

which  ensures  the  numerical  stability  of  the  transformations  to  and  from  the  resulting  bases. 
Note  that  any  such  basis  is  uniquely  determined  by  the  function  b. 

The  plan  of  the  paper  is  as  follows.  In  the  remainder  of  this  section  we  review  some 
of  the  existing  techniques  for  the  compression  of  functions.  In  Section  2  we  construct  bi- 
orthonormal  bases  that  are  a  generalization  of  MCM  wavelets.  In  Section  3  we  formulate 
the  variational  problem  of  the  computation  of  functions  b  leading  to  efficient  compression  of 
trigonometric  functions  (1)  while  maintaining  the  bounds  (3)  and  (4).  This  problem  is  solved 
exactly  in  Section  4.  In  Section  5  we  compare  the  performance  of  our  scheme  with  that  of  other 
algorithms.  Finally,  in  Appendix  we  discuss  an  alternative  construction  leading  to  a  somewhat 
different  type  of  bases. 

l.J.  MCM  Bases 

The  point  of  departure  for  the  construction  of  MCM  wavelets  is  the  foUowing  wdl  known 
theorem,  that  in  a  slightly  different  form  can  be  found,  for  example,  in  Chap.  2  of  Tolstov  [19]. 
Tkeorem  1.1.  The  sequence  of  functions 

{2'/^  sin(n  +  l/2)7r*},  (5) 

where  n  =  0, 1,2, ...,  ts  an  orthonormal  basis  on  [0, 1].  • 

The  simplest  version  of  MCM  wavelets  based  on  the  system  (5)  is  given  by  the  theorem 
below  (see,  fmr  example,  Chap.  6  of  Meyer  [16]) 

Theorem  1.2.  Let  6 :  R  — »  R  he  an  arbitrary  function  such  that 

6*(x)  +  6’(— x)  5=  1  for  all -1/2  <  X  <  1/2, 

6(x)  =  6(1  -  x)  for  all  1/2  <  x  <  3/2, 

6(x)  =  0 
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otherwise. 


(6) 

(7) 

(8) 


Then  the  sequence  of  functions 

"n(®)  =  «n(®  -  *)> 

(9) 

where  n  s  0,1,2,...,  k  =  0,±1,±2, ...,  and 

ti°(x)  =  2*^^6(x)  sin(n  +  l/2)irx, 

(10) 

is  an  orthonormal  basis  on  the  real  line.  • 

The  fiinctioc  6  in  (10)  is  usually  referred  to  as  the  bell  function  or  the  bell.  Interesting  and 
useful  extensions  of  Theorem  1.2  can  be  found,  for  example,  in  [3]  and  [16]. 

Remark  1.1.  Let  the  sequence  of  coefficients  {/*}  be  defined  via  the  formula 

fn=  f  f(x)u!^(x)dx.  (11) 

J^OO 

Then  Theorem  1.2  implies  that 

/w=  E  E/Ww  (12) 

fcs— oo  nsK) 

almost  everywhere  on  the  real  line.  • 

Recent  applications  of  MCM  bases  to  compression  of  functions  can  be  found  in  [1],  [5],  and 

[6]. 


l.S.  Bi-Orthonormal  Bases 

An  eluant  and  important  generalization  of  the  concept  of  orthonormal  wavelet  bases  are 
the  so  called  H-orthonormal  or  Riesz  bases  (see,  for  example.  Chap.  8  of  Daubechies  [9]).  The 
principal  analytical  tool  in  this  case  is  the  following  well  known  theorem,  that  in  a  slightly 
different  form  can  be  found,  for  example,  in  Chap.  4  of  Meyer  [16]. 

Theorem  1.3.  Let  and  {^n}  ^  bases  in  L^(R.)  such  that 

/  <f>n{x)<f„^ix)dx  =  Snm,  (13) 

y— oo 

where  ^nm  is  Kronecker’s  delta.  Then  for  any  f  €  L^(R.), 

/(*)=  E  On^n(®),  (14) 

ns— oo 
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vihere 


(15) 


SimUariy, 


where 


/oo 

f{x)<f>n{x)dx. 

■00 

/(*)=  S 


(16) 


(17) 


/oo 

/(a:)<^„(i)dx.  • 

-OO 

Usually  the  system  {^n}  is  referred  to  as  the  basis  dual  to  {^n}- 
The  following  theorem  and  its  corollary  are  immediate  consequences  of  Theorem  1.3. 
Theorem  1.4.  Let  {^n}  ond  he  bi-orikonormal  bases  in  i^(R).  Then  for  any  f  6  .^^(II) 
and  g  €  L\Wi), 

/OQ  00  OO 

f{x)gix)dx=  53  /n§n=  53 

n=— oo  n=— oo 


(18) 


where 


and 


fn=  I  f(x)<i>n(x)dx, 
— 00 

/OO 

9{x)<f>n{x)dx, 

•00 

/n=  /  f{x)^n{x)dx, 
^—00 

9n=  f  9ix)^n{x)dx.a 

OO 


Corollary  1.1.  For  any  f  €  L\Wi), 


f  f{x)dx=  53  /»*/»*’ 

n=-oo 


(19) 

(20) 

(21) 

(22) 

(23) 


where  the  coefficients  fn  and  fn  are  defined  in  (19)  and  (SI).  • 

A  recent  example  of  data  compression  in  bi-orthonormal  bases  can  be  found  in  [13]. 
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2.  Construction  of  Local  Trigonometric  Bases 

In  this  section  we  construct  local  trigonometric  bases  (and  their  dual  bases)  with  bell 
functions  that  do  not  necessarily  satisfy  the  condition  (6).  These  bi-orthonormal  bases  are  a 
generalization  of  MCM  wavelets. 


2.1.  Notation  and  Definitions 


This  subsection  contains  basic  notation  and  definitions  to  be  used  in  the  remainder  of  the 
paper. 

Let  a  continuous  function  w  :  [—1/2, 1/2]  R  satisfy  the  condition 

w^(x)  +  w^(—x)  0.  (24) 


The  function  w  :  [—1/2, 1/2]  R  is  defined  by  the  formula 


-/  x<faf 

ti>(x)  = 


w(x) 


w^(x)  +  w^-x)’ 

The  hell  function  (or  the  bell)  6 :  R  — »  R  will  be  defined  by  the  formula 


(25) 


tn(x)  for  all  —1/2  <  *  <  1/2, 

to(l  —  x)  for  all  l/2<x<3/2, 

0  otherwise. 


(26) 


where  tn  is  am  arbitrary  function  satisfying  (24).  The  function  6  :  R  -»  R  defined  by  the 
formula 


6(x)^ 


ti>(x)  for  all  — l/2<x<l/2, 

t&(l  —  x)  for  all  1/2  <  X  <  3/2, 

0  otherwise, 

with  w  defined  in  (25)  will  be  called  the  dual  bell  fu/iction  (or  the  dual  belt)  to  b. 

Let  0  :  R  R  be  defined  by  the  formula 

-1/2 


(27) 


e{x) 


=  (t 


The  fdlowing  properties  of  ^  are  immediate  consequences  of  (26)  and  (28): 

0(x  -  m)  =  0(x)  for  all  m  =  0,  ±1,  ±2, ..., 


(28) 


(29) 
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for  ail -1/2  <  I  <  1/2,  (30) 


^(-x)  =  ^{x)  = 


6^(1)  +  6^(-*)  “  w\x)  +  ti;^(-x) 

tf(l  —  i)  =  8{x)  for  ail  1/2  <  x  <  3/2. 


The  combination  of  (25)  -  (27),  (30),  and  (31)  yields 

bix)  =  0^ix)-b{x).  (32) 

Next,  for  k  =  0,±1,±2...  and  n  =  0,1,2,...  we  define  (locally  supported)  functions  u*  ; 
R  R  and  fi*  :  R  -♦  R  by  the  formulae 

«n(®- *).  (33) 

(34) 

where 

u°(x)^  2^^^6(x)  sin(n  +  l/2)jrx,  (35) 

ti®  (x)  ^  2^^*6(x)  sin(n  +  1  /2)tx.  (36) 

The  functions  6  and  b  in  (35)  and  (36)  are  defined  by  (26)  and  (27),  respectively.  Since 
functions  and  u*  are  locally  supported,  they  will  be  referred  to  as  functions  belonging  to  a 
ft-th  interval.  In  Theorem  2.1  below  we  show  that  the  collections  of  functions  {u*}  and  {u*} 
are  bi-orthonormal  bases. 

Let  a  be  a  real  number  and  suppose  that  /  €  L*([at— 1/2,  a-f- 1/2])  and  w  6  L*([— 1/2, 1/2]). 
Suppose  further  that  w  satisfies  the  condition  (24).  Then  the  folding  operator  :  L^(R)  -*■ 
L^(R)  and  the  unfolding  operator  :  L^(R)  —>•  L^(K.)  are  defined  by  the  formulae 

/(x)  •  w(x  —  a)  —  /(2a  —  x)  •  i»(a  —  x)  for  all  o  <  x  <  a  +  1/2, 

FS(f)(x)  ^  •  f(x)  •  w(a  —  x)  +  f(2a  —  x)  •  w(x  —  a)  for  all  a  —  1/2  <  x  <  a,  (37) 

0  otherwise. 


I/(x)  •  t»(x  —  a)  + /(2a  -  x)  •  to(a  —  x)  for  all  a<x<a  +  l/2, 

/(x)  •  to(a  —  x)  - /(2a  -  x)  •  io(x  —  o)  for  all  a  — l/2<x<a,  (38) 

0  otherwise. 
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The  combination  of  (25),  (29)  -  (31),  and  (37)  yields 

o/)(«) =«’(»)■';(/)(*)•  (39) 

Next,  for  Ar  =  0,  ±1,  ±2...  and  n  =  0, 1, 2, ...  we  define  auxiliary  (locally  supported)  functions 
u*  :  R  R  via  the  formula 

(40) 

where  the  functions  are  defined  by  (33)  and  (35).  Note  that  due  to  (32)  the  relation  (40) 
can  be  rewritten  in  an  equivalent  form 

.;(!) =  s5(x)/»(x),  (41) 

where  the  functions  are  defined  by  (34)  and  (36). 

Finally,  for  any  basis  {u^}  we  define  its  atndiiion  number  Tcond  by  the  formula 

ramd^  max  M^)-  (42) 

*6[-1/2.3/2J  ^  ^  " 

Remark  2.1.  It  is  easy  to  see  that  as  long  as  (3)  holds,  5  >  0,  and  is  reasonably  small 
(ramd  l)i  functions  ti*  and  u*  are  bounded  by  a  number  of  order  1,  and  therefore 
forward  and  inverse  transforms  in  bases  {u^}  are  numerically  stable.  In  this  respect  the  defi¬ 
nition  (42)  serves  the  same  purpose  as  the  definitions  of  the  condition  number  for  other  linear 
transformations  (see,  for  example,  the  corresponding  definition  for  matrices  in  Chap.  4  of  Stoer 
and  Bulirsch  [18]).« 

S.2.  Bases  {«*}  and  {«*} 

In  this  subsection  we  establish  analogues  of  Theorems  1.3  and  1.4  for  the  collections  of 
functions  {u*}  and  {u*}  defined  in  (33)  -  (36).  We  start  with  the  following  lemma,  which  will 
be  used  to  reduce  the  proofs  of  bi-orthonormality  and  completeness  of  {u^}  and  {tt^}  to  simple 
manipulations  with  MCM  bases. 

Lemma  2.1.  Suppose  that  an  arbitrary  function  w  €  L^([-l/2, 1/2])  satisfies  (24)  and  the 
bell  function  b  is  defined  in  (26).  Then  any  set  of  functions  {u*}  defined  in  (40)  is  an  MCM 
basis. 
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Proof.  For  any  fc  =  0,±1,±2,...  and  n  =  0, 1,2,...  the  combination  of  (29),  (33),  (35),  and 
(40)  yields 

®n(*)  =  »n(®  -  *).  (43) 

with 

'  ^(*)  sin(n  +  l/2)irx,  (44) 

while  from  (26),  (30),  and  (31)  we  have 

b^(x)  •  e^(x)  +  b^(-x)  ■  ~  1  for  all -1/2  <  X  <  1/2,  (45) 

and 

6(x)  •  tf(x)  =  6(1  —  x)  *^(1  —  x)  for  aU  1/2  <  X  <  3/2.  (46) 

Next,  due  to  (26), 

6(x)  •  0(x)  =:  0  for  all  |x  -  1/21  >  1-  (47) 

Now  we  see  from  (43)  -  (47)  that  the  collection  of  functions  {t>*}  satisfies  all  the  conditions  of 
Theorem  1,2  (with  the  product  $  •  6  playing  the  role  of  the  bell  function  6),  and  therefore  it  is 
an  MCM  basis.  • 

The  foUowing  theorem  proves  the  bi-orthonormality  and  completeness  of  the  collections  of 
functions  {«*}  and  {«*}. 

Theorem  2.1.  Suppose  that  the  collections  of  functions  {u*}  and  {«*}  ore  defined  in  (SS)  - 
(S6)  with  the  bell  functions  b  (26)  defined  in  Lemma  2.1.  Let  n,m,k,  and  I  be  integers  such 
that  n  >  0,  m  >  0.  Then 

I  =  SklSnm.  (48) 

•/— 00 

Moreover,  let  for  an  arbitrary  function  f  €  L^{JR.)  the  coefficients  /*  5e  defined  via  the  formula 

fn  =  r  fi^)<ix)dx.  (49) 

7—00 

Then 

/(*)=  H  £/n«n(®)>  (50) 

Ass— 00  n=0 
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almost  everywhere  on  the  real  line. 
SimUarly,  if 


fn=  1 

J'—OO 

(51) 

then 

E  E/MW, 

(52) 

fc=— 00  n=0 

almost  everywhere  on  the  real  line. 

Proof.  The  formula  (48)  is  an  immediate  consequence  of  the  orthonormality  of  the  system 

and  the  relation 

«n(*)  •  «m(*)  =  »n{*)  '  "mC®). 

(53) 

which  in  turn  immediately  follows  from  (40)  and  (41). 

The  equality  (50)  can  be  easily  proven  by  expanding  an  auxiliary  function  p  £  I'^(ll), 

defined  by  the  formula 

p(x)  =  /(x)/«(x), 

(54) 

in  the  basis  {«*}.  In  fact,  it  follows  from  (11)  and  (12)  that  if 

f>n  =  /  P{x)Vn{x)dx, 

^—00 

(55) 

then 

P(®)=  £  £pn»n(®) 

(56) 

fcs=— oo  nssO 

almost  everywhere  on  the  real  line.  Now  (50)  is  a  consequence  of  (54)  - 

(56),  (40),  and  (41). 

The  proof  of  (52)  cao  be  obtained  by  expanding  an  auxiliary  function  q  €  defined 

by  the  formula 


q{x)  =  f{x)  ■  e{x)  (57) 

in  the  basis  {v^},  and  repeating  the  proof  of  (50)  almost  verbatim.  • 

Remark  2.2.  Since  the  functions  u*  and  (fc  =  0,  ±1,  ±2, n  =  0, 1, 2, ...,)  are  periodic  with 
period  1  (see  the  formulae  (33)  and  (34))  while  the  functions  u°  and  tt°  are  locally  supported 
on  [-1/2, 3/2],  the  definitions  (49)  and  (51)  can  be  rewritten  in  the  form 

/n=  /  /(®)«i(®)<iar,  (58) 

Jk-l/2 
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and 

/fc+3/2 

/*=/  f{x)ut(x)dx..  (59) 

Jk-1/2 

Finally,  Theorem  2.2  and  Corollary  2.1  below  are  particular  cases  of  Theorem  1.4  and 
Corollary  l.I,  and  they  immediately  follow  from  Theorem  2.1. 

Theorem  2.2.  For  any  f  €  and  g  € 

/  f(x)9ix)dx=  53/nfln=  £  12 /nS^  (60) 

Jfc=-oo  n=0  *=-oo  n=0 


tshcre  and  fh,gn  are  the  expansion  coefficients  of  the  functions  f  and  g  in  the  bases  {u*} 
and  {u*},  respectively.  • 

Corollary  2.1.  For  any  f  €  1^(11), 


f  f{x)dx=  Y 

fc=-oo 

(61) 

xohere 

/  oo  \  1/2 

\\f\kk)^^(Zfnf^)  •  • 

\n=0  / 

(62) 

In  Remark  2.3  below  we  show  that  \\f\\(k)  (02)  satisfies  all  the  conditions  of  a  norm  and  we 
will  call  this  parameter  the  norm  of  /  on  the  A;-th  interval. 


S.S.  Folding  of  a  Function. 

The  implementation  of  forward  and  backward  transforms  in  bases  {«*}  as  well  as  certain 
proofs  can  be  simplified  by  means  of  foldings  [3],  [1].  We  begin  with  a  theorem,  that  establishes 
a  connection  between  folding  F  (37)  and  unfolding  U  (38)  operators;  its  proof  is  an  immediate 
consequence  of  the  definitions  (25),  (37),  and  (38) 

Theorem  2.3.  Let  w  :  [—1/2, 1/2]  — »■  R  satisfy  the  condition  (24)  and  w  :  [—1/2, 1/2]  — ►  R  6e 
defined  via  (25).  Then 

1/5  •  =  1,  (63) 

and 

=  h  (64) 
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vjhere  the  operators  F  and  U  are  defined  by  the  formulae  (37)  and  (38),  respectively.  • 

Theorem  2.4  below  expresses  coefficients  /*  and  /*  of  an  arbitrary  function  /  G  as 

standard  Fourier  coefficients  of  certain  auxiliary  functions. 

Theorem  2.4.  Suppose  that  the  function  /<; :  [A:,  Ar  +  1]  — >•  E  ts  defined  via  the  formula 

+  (65) 

where  f  G  on  arbitrary  function  and  the  operator  F  is  defined  by  (37).  Then 

fk  _  2^/2  •  sin(n  +  l/2)ir(x  -  k)dx,  (66) 

and 

=  2^/®  52  /*  sm(n  +  l/2)ff(i  -  fc)  (67) 

n=0 

almost  everywhere  on[k,k-\- 1], 

Similarly, 

/*  =  2^^^  f  ^*(®)  •  A(®)  •  sin(n  +  l/2)7r(®  —  fc)dx,  (68) 

Jk 

and 

^(®)  •  A(*)  =  2'/^  52  fn  sm(»  -r  l/2)jr(x  -  fc),  (69) 

?i=0 

almost  everywhere  on  [fc,fc  +  1]. 

Proof.  Observing  that  sm(n  +  l/2)5r(x  —  fc)  is  an  odd  function  of  x  -  fc  suid  an  even 
function  of  x  -  fc  -  1,  and  combining  (58)  and  (37)  we  immediately  obtain  (66).  Analogously, 
(68)  immediatdy  follows  from  (59),  (39)  and  (65).  The  formulae  (67)  and  (69)  are  immediate 
consequences  of  (66)  and  (68),  respectively,  and  Theorem  1.1.  • 

Now  the  expansion  coefficients  /*  can  be  obtained  by  first  folding  the  function  /  at  every 
int^er  point  a  =  fc  by  means  of  (37)  (which  produces  A  <>“  every  segment  x  G  [fc,  fc  +  1]),  and 
after  that  evaluate  standard  sine  coefficients  (66)  on  all  the  segments.  Conversely,  to  apply  the 
inversion  formula  (50)  one  can  first  compute  the  functions  (65)  for  every  integer  fc  by  summing 
the  sine  series  (67),  and  then  unfold  the  obtained  function  for  every  fc  via  (38)  and  (63). 
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Remark  2.3  It  is  easy  to  show  that  the  parameter  ||/||(;i;)  defined  in  (62)  is  a  norm.  Indeed, 
combining  (67)  and  (69)  we  have 

fi(x)  ■  f}(x)dx  =  •£  fifi  =  ll/llfj),  (70) 

n=0 

i.e.  l|/|l(jk)  is  the  norm  of  /*  with  the  weight  6^  • 

Remark  2.4  It  immediately  follows  from  (67)  that 


3.  Optimization  of  Bell  Functions:  Statement  of  the  Problem 

In  this  section  we  formulate  a  problem  of  the  construction  of  bases  {u^}  that  efficiently 
compress  trigonometric  functions  (1)  and  whose  condition  number  tcond  ^  I-  Since  any  basis 
uniquely  determined  by  the  beQ  function  b  this  problem  can  be  formulated  as  the 
problem  of  an  appropriate  selection  of  6.  The  prindpal  result  of  this  section  consists  in  reducing 
the  problem  of  an  appropriate  selection  of  the  bell  b  to  a  minimization  problem  for  a  quadratic 
functional  (see  the  formula  (125)  below). 

S.I.  Compression  in  Bases  {tt*} 

Since  bases  {tt^}  are,  in  general,  not  orthogonal  the  computation  of  relative  errors  of  com¬ 
pression  of  functions  in  these  bases  can  become  very  difficult.  Consequently,  any  optimization 
of  these  bases  (i.e.  selection  of  such  bases  that  with  a  given  error  approximate  functions  of 
a  spediied  class  with  the  least  number  of  coefficients)  becomes  a  complicated  problem.  In 
this  subsection  we  observe,  however,  that  the  optimization  of  a  wide  class  of  bases  {u^}  is 
almost  equivalent  to  a  simpler  problem.  We  bepn  with  a  lemma  that  expresses  (62)  in  a  form 
containing  only  coefficients  /*;  its  proof  is  an  immediate  consequence  of  (67)  and  (70). 
Lemma  3.1.  For  any  integer  k, 

fk+\  /  oo  \  ^ 

||/||f„=2jf  «“(!).( 5;/i8m(»+l/2)>v(i-fc)j  dx,  (72) 
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where  ||/|1(*)  is  defined  by  (62).  • 

The  formulae  (73)  and  (74)  below  introduce  two  parameters  that  play  an  important  role  in 
the  formulation  of  the  optimization  problem. 

For  a  function  f  £  let  {/*}  denote  its  set  of  coefficients  with  respect  to  a  basis 
For  every  k,  we  denote  by  5*(/,  6)  any  subset  of  {/„}  that  consists  of  the  least  number  of 
coefficients  for  which  the  following  inequality  is  satisfied: 


.def 


KSHf,b))  = 


ll/ll(A:)  “  2  /  $^(x) '  (  ^  fn  sin(n  +  l/2)z-(ar  -  Ar)^ 

_ Z _ VesHU) _ J 

iiTiiS; 


2  \ 
dx 


1/2 


f  6^(x)-l  /^sin(n  +  l/2)jr(®- A:)')  dx 

_ _ _ J 

rk+l  (  00  ~  \  2  ■ 

I  f!t  siB(n  +  l/2)7r(x  -  fc) j  dx 


1/2 


<  €. 


(73) 

The  number  of  coefficients  belonging  to  5*(/,b)  will  be  denoted  by  N^{f,  b)).  In  (73),  e  €  (0, 1) 
is  a  specified  (small)  number  and  b  is  the  bell  of  the  basis  {«*}.  The  parameter  d(5e*(/,6))  is 
the  relative  error  in  the  norm  (62)  of  compressing  /  on  a  ife-th  interval,  i.e.  setting  to  zero  all 
the  coefficients  /*  that  do  not  belong  to  the  subset  5*(/,6).  Note  that  5*(/,6)  depends  on  /, 
6,  and  c. 

Similarly  to  (73),  for  every  k  we  choose  a  finite  subset  5*(/,  6)  consisting  of  the  least  number 
of  coefficients  iV*(/,  6)  for  which  the  following  inequality  holds: 


/■*+!  /  «  .  ^ 
J.  E  /«sin(n+l/2)ir(x-A:) 

Vn«5*(/,6)  J 

2  \ 

dx 

1/2 

E  (fiA 

/ 

,  tifir 

\  n=0  / 

1/2 


<  €. 


(74) 


In  (74)  the  equality  of  the  first  and  second  fractions  is  a  consequence  of  the  orthogonality  of 
functions  sin(n  +  l/2)ir{x  —  fc)  (n  =  0, 1,...)  on  [fc,fc  +  1]  and  the  formula  (67).  Analogously 
to  (73)  the  parameter  ^(5*(/,  b))  is  the  relative  error  of  compressing  the  function  fk,  which 
immediately  follows  from  (71). 

Theorem  3.1  below  establishes  a  connection  between  relative  errors  S  (73)  and  S  (74). 
Theorem  3.1.  For  any  continuous  6  defined  in  (28)  and  fk  defined  in  (67)  there  exists  k  €  B-|. 
such  that 

SiS^if,b))<K-e,  (75) 

and 

Ks':{m)<K-e,  (76) 

Furthermore,  k  satisfies  the  inequality 

1/e  <  K  <  e,  (77) 


where  0  is  defined  by  the  formula 

max  d(x) 

^  def  *€[0,1/2) 

min  tf(:r)' 

x€(0.1/2l 

Proof.  We  start  with  the  proof  of  (75).  This  inequality  can  be  written  as 

.1/2 


•  f  53  /n  »“(»  +  V2)jr(»  -  *))  dx 
/  ^(®)  i^fh  +  l/2)ir(i  -  fc)]  dx 

\naO  / 


which  is  an  immediate  consequence  of  (73). 

Combining  the  mean  value  theorem  with  (29)  and  (31)  we  obtain 


< 


[  ^(*)  '  I  13  +  l/2)?r(x  -  A;)  I  dx  = 

*  \ne5*(..6)  ' 


ffe+1 


^(6)-/  I  5Z  /^s“(»+l/2)*-(®-A:)  I  dx, 


(78) 


(79) 


(80) 
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and 

/■ife+i  /  \  ^ 

•  (  E  fn  si»(«  +  l/2)ir(x  -  fc)  j  dx  = 

fk+l  /  o°  \  ^ 

^^(6)-^  ^X^/nSin(n+ l/2)T(x-k)J  dx, 

where  0  <  ^1,^2  <  1/2.  Now  the  inequality  (75)  is  a  consequence  of  (78),  (80),  and  (81).  The 
proof  of  (76)  is  analogous  to  that  of  (75)  and  we  omit  it.  • 

Remark  3.1.  Obviously,  the  natural  norm  of  computing  errors  of  functions’  compression 
is  the  norm  (62)  that  is  closely  related  to  the  norm.  Then  the  optimization  of  bases  for  a 
particular  function  /  and  fixed  <  consists  in  finding  such  bell  function  6  for  which  the  subset 
S*(/,  b)  consists  of  the  least  number  of  coefficients  iV*(/,  b).  However  optimization  in  the  norm 
(62)  is  a  complicated  problem  because  this  norm  involves  both  coefficients  and  /^.  In 
addition,  subsets  S^(f,  b)  do  not  necessarily  contain  N^{f,  b)  largest  coefficients  f^.  In  this 
remark  we  observe  that  for  a  wide  selection  of  functions  /  the  optimization  of  bells  b  in  the 
norm  (62)  is  almost  equivalent  to  their  optimization  in  the  norm  (71).  Note  that  the  norm  (71) 
involves  only  coefficients  while  all  the  subsets  5*(/,5)  consist  of  Nf{f,b)  largest  coefficients 
Jn’ 

In  fact,  the  formulae  (73),  (74),  and  (75)  show  that  if  (for  any  given  b  and  /,  and  fixed  e) 
we  set  to  zero  all  the  coefficients  /*  that  do  not  belong  to  a  subset  5*  then  the  upper  bound  of 
the  relative  error  of  such  an  appro^dmation  in  the  norm  (62)  does  not  exceed  k  •  e.  Therefore 
for  /c »  1  (i.e.  when  6  »  1)  and  sufficiently  smooth  6  and  /  we  expect  that  the  subsets  5*  and 
5*  almost  coindde.  • 

Now  we  turn  to  discussing  the  compression  of  the  functions  (1)  in  bases  {u*}.  Due  to 
periodidty  of  both  cosine  and  functions  u*  without  loss  of  generality  we  will  consider  expansions 
of  these  functions  only  on  the  interval  [-1/2, 3/2]  (i.e.  for  k  =  0).  We  will  write  the  coeffidents 
of  functions  (1)  on  this  interval  as  /„  (instead  of  /J^).  Finally,  for  these  functions  numbers 
Wf(/,b)  (see  their  definition  in  Subsection  3.1)  will  be  denoted  by  Nt(a,  u,b). 

Lemnoa  3.2.  For  any  u,  a,  and  n>0  the  coejBficients  fn  of  the  function  f  defined  in  (1)  are 
given  by  the  formula 

/„  =  2-1/2  (8in(a  +  A;/2)-R(>4;)  +  8in(-o  +  ^!l/2)-R(^!l)),  (82) 
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when 


^(9)  =  /  ^(*  +  1/2)  •  exp(iqx)dx, 

•/— 00 


(83) 


and 


=  w  +  (n+ 1/2)*-,  =  -<*;+ (b  +  l/2)jr.  (84) 

Proof.  First  we  observe  that  b(x  +  1/2)  is  an  even  function  of  x,  which  immediately  follows 
from  the  definition  (26),  and  thus  its  Fourier  transform  B  (83)  is  a  real  even  function.  Therefore 
combining  (1),  (35),  and  (49),  we  have 

fn  =  2^^*  r°  b(x)  •  cos(wz  +  a)  •  sm(n  +  l/2)irx)dx  = 

J—CO 

2-1/2CJ  ^exp(ta)  6(z)exp(t  •  ^4^.  •  x)dx'^  + 

^&cp(-ia)  J  h(*)  exp(»  •  •  *)da:^  =  (85) 

2-1/35  i(a  +  A^/2)  •  j  b(x  +  l/2)exp(iA'l)dz^  + 

2-1/35  ^lexp  t(— a  +  AZ./2)  •  6(*  +  1/2)  exp(M“  )<fa!^  , 

and  now  the  formula  (82)  follows  from  (83)  and  (85).  • 

Ramark  3.2.  In  this  remark  we  observe  that  fi3r  w  >  1,  a  jt  irl/2  (/  =  d:l,±3,±5...,)  and 
sufSdently  smooth  bells  6, 

iVc(a,  w,  b)  «  2JV«(0, 0,  b).  (86) 

Indeed,  since  the  function  b  in  (26)  is  int^able,  we  have  (see,  for  example.  Chap.  7  of 
Tolstov  (191) 

^lig^R(g)  =  0,  (87) 

and  therefore  for  any  n  >  0  and  u;  >  1, 

/„  «  2”'/*  8m(a  +  AZ/2)  •  B{AZ)  =  2"*/^  sin(Q  +  Al /2)  •  B(-w  +  (n  +  l/2)x),  (88) 
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which  is  a  consequence  of  (82),  (84),  and  (87).  On  the  other  hand,  for  u)  =  0  the  combination 
of  (82)  and  (84)  yields 

fn  =  2*^®cos(o)  •sin(irn/2  +  ir/4)*  B((n  +  l/2)n).  (89) 

Combining  (88)  and  (89)  we  see  that  if  B  decays  sufficiently  fast  (i.e.  when  6  is  sufficiently 
smooth),  o  ^  jr//2  (1  =  ±1,  ±3,  ±5...),  and  w  >  1, 

b)  !%s  2JV«(a,  0, 6).  (90) 

Next,  for  arbitrary  b,  <,  and  a  ^  x//2  (/  =  ±1,  ±3,  ±5...)  the  numbers  Nf{a,  0,  b)  do  not  depend 
on  a  and,  due  to  (74),  coindde  with  numbers  IVf (/,  b)  for  the  function 

/(*)  =  !.  (91) 

Now  combining  this  observation  with  (90)  we  immediately  obtain  (86).  • 

S.2.  Optimized  Bases  for  Trigonometric  Functions 

In  this  subsection  we  give  an  informal  description  of  the  construction  of  the  bases  {u*}, 
hereafter  referred  to  as  optimized  bases,  that  efficiently  compress  trigonometric  functions  (1). 
This  scheme  involves  two  observations  that  significantly  simplify  this  problem. 

1)  The  selection  of  bases  {»*}  with  6  »  1  and  reond  ^  1  ensures  the  numerical  stability  of 
forward  and  inverse  transforms  in  these  bases  (see  Remark  2.1),  and  reduces  their  optimization 
in  the  norm  (62)  to  an  almost  equivalent  but  a  much  simpler  problem  of  optimizing  them  in 
the  norm  (71)  (see  Remark  3.1). 

2)  Furthermore,  for  sufficiently  smooth  bells  the  bases  optimized  for  the  function  (91)  in 
the  norm  (71)  are  almost  optimal  (in  the  same  norm)  for  the  functions  (1)  (see  the  relation 
(86)  in  Remark  3.2). 

S.S.  Construction  of  Optimized  Bells  as  a  Variational  Problem 

In  this  subsection  we  formalize  constructing  of  optimized  bases  discussed  in  Subsection  3.2. 
We  start  with  the  explicit  formula  for  the  expansion  coefficients  of  the  function  (91). 
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Combining  (26),  (35),  and  (58)  with  (91)  we  have 


/„  s=  2*^*  /  b(x)sin(n  +  \l2)rxdx  =  2  /  tB(ar)^„(x)<ix, 

J-l/2  J-\I2 


1/2 

1/2 


(92) 


where 

^(x)  =  2“^/^  (sin(n  +  l/2)irx  +  (—1)"  cos(n  +  l/2)xx)  = 


(93) 


(-1)”*  8in(n  +  l/2)x(x  +  1/2). 

In  (93)  m  =  [(n  +  l)/2]  with  the  symbol  [x]  denoting  the  integer  part  of  x. 

It  is  natural  to  suppose  that  for  sufficiently  smooth  bells  b  the  first  several  coefficients  /„ 
(92)  decrease  as  a  function  of  n.  Therefore  the  bdl  optimal  for  the  function  (91)  in  the  norm 
(71)  can  be  obtained  from  the  condition 


00 


miB 

{«} 


nsN 


(94) 


We  expect,  that  as  N  (the  number  of  the  optimized  coeffidmits)  in  (94)  increases,  the  value  of 
this  sum  decreases  thus  providing  a  smaller  value  of  the  relative  error  6  (74). 

B«niark  3^.  It  is  tempting  to  solve  (94)  under  the  MCM  condition  (6)  thus  obtaining  an 
optimized  orthonormal  basis  with  s  6  =  1.  However,  the  solution  of  the  variational 
problem  (94)  for  MCM  bells  (6)  does  not  yield  a  bell  suitable  for  the  compression  of  functions 
(1). 

In  fact,  the  fnncti<m 

{^(x)  SB  sin(ir(x  +  l/2)/2)  for  all  -1/2  <  x  <  3/2, 

(95) 

0  otherwise 

satisfies  the  conditions  (6)  -  (8)  (i.e.  the  basis  {u^}  with  this  bell  is  an  MCM  basis)  as  weQ  as 
the  condition  (3).  Now  the  combinsition  of  (92)  and  (95)  yields 

/„  =  2^/*  /  sin(ir(x  +  l/2)/2)sin(n  +  l/2)xxdx  = 

J-l/2 

(-1)”*2®/*  f  sin(x(x  +  l/2)/2)  •  8in(n  +  l/2)ir(x  +  l/2)dx  =  2^/^ion, 

J-l/2 
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wher«  m  =  [(n  + 1)/2],  and  thus  the  function  (95)  provides  the  solution  for  (94).  However,  the 
Fourier  transform  of  b  (95)  decays  very  slowly  and  therefore  the  basis  with  such  a  bell  cannot 
efficiently  compress  functions  (1)  with  u  ^0.  • 

Remark  3.4.  The  Gaussian  beO  function 

{exp  (-a(a  -  1/2)*)  for  all  -l/2<x<3/2, 

(97) 

0  otherwise, 

where  a  s  l/ln(l/<)  provides  a  value  of  the  sum  in  (94)  that  is  close  to  its  absolute  minimum. 
This  property  of  the  Gaussian  (97)  (with  an  appropriately  chosen  c  =  e(^))  is  a  consequence 
of  Hdsenberg’s  inequality  (see,  for  example,  Chap.  2  of  Dym  and  McKean  [10]).  However,  it 
is  easy  to  see  that  for  bases  with  the  bell  (97)  we  have 

reand  »  (98) 

and 

0  »  (99) 

and  thus  for  small  €  the  inverse  transformation  (50)  in  such  bases  becomes  numerically  tmstable. 
An  example  of  this  instabffity  is  ffiscussed  in  Subsection  5.5  below.  • 

In  Lemma  3.3.  bdow  we  establish  a  dass  of  bdls  for  which  re»nd  ^  1  aiid  0  1. 

Lemma  3.3.  Let  a  reoLvahted  function  w  €  1/2, 1/2]  satisfy  (24)  and  suppose  that 


«;(*) +  «?(-*)  =  1, 

(100) 

and 

>0  forall0<*<  1/2. 
dx 

(101) 

Furthermore,  suppose  that  for 

some  Xq  €  [0, 1/2), 

to(xo)  s=  2“'^*. 

(102) 

Then  on  (—1/2, 1/2)  the  function  w  defined  in  (25)  has  the  unique  mcaimum  at  x  =  xq  and 

to(xo)  =  (2'/^  +  l) /2,  (103) 
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vthUe  on  the  same  interval  the  function  6  defined  in  (47)  has  the  unique  maximum  at  x  =  0, 
and 

«(0)  =  2‘/2.  (104) 

Proof.  We  start  with  the  analysis  of  the  function  w  at  the  point  x  =  xq.  We  first  observe  that 


>0  for  all  —1/2  <  x  <  1/2, 
dx 

(105) 

which  is  an  immediate  consequence  of  (100)  and  (101).  Substituting  (100)  into  (25)  we  have 

"’W  ~  2w2(x)  -  2u>(x)  +  r 

(106) 

and  thus 

dw(x)  dw(x)  1  —  2u)\x) 

dx  dx  (2tif^(x)  —  2‘w(x)  +  1)^  ’ 

(107) 

which  in  combination  with  (102)  yields 

dw(xo)  _ 
dx  ~ 

(108) 

Next,  combining  (102),  (105),  and  (107)  we  have 

>0  for  all  -1/2  <  *  <  ®o» 
dx 

(109) 

and 

<0  for  all  xo  <  X  <  1/2. 
dx 

(110) 

It  immediately  follows  from  (108)  -  (110)  that  x  =  zq  is  the  unique  maximum  of  the  function 
to  on  (—1/2, 1/2).  Finally,  the  relation  (103)  is  a  consequence  of  (102)  and  (106). 

We  now  turn  to  the  proof  of  (104).  First  we  observe  that 


ti;(0)=l/2,  (111) 


whidi  immediately  foUows  from  (100).  Substituting  (100)  into  (30)  we  have 

“  (2«;3(«)  -  2to(x)  +  1)1/2’ 


(112) 
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and  therefore 


(113) 


dB(x)  _  dw(x)  _ 1  —  2w(x) _ 

dx  dx  (2ti>*(a:)  —  2tu(x)  +  l)^/^’ 

which  in  combination  with  (111)  yields 


dBjO) 

dx 


=  0. 


Combining  (105),  (111),  and  (113)  we  have 

^^>0  for  all -1/2  <  X  <  0, 


(114) 


(115) 


and 

<0  for  all  0  <  X  <  1/2.  (116) 

dx 

Formnlae  (114)  -  (116)  show  that  x  =  0  is  the  nniqne  maximum  of  0  on  (-1/2, 1/2).  Finally 
(104)  is  obtained  by  substituting  (111)  into  (112).  • 

Remark  3.5.  In  this  remark  we  compute  the  condition  number  Veand  (42)  and  the  parameter 
0  (78)  for  bells  that  satisfy  the  conditions  (3)  and  (100)  -  (102).  Note  that  (3)  is  equivalent  to 


0  <  w(x)  <  1, 


(117) 


which  follows  from  (26). 

Combining  (103)  and  (42)  we  obtain 

W=(2*/"  +  l)/2.  (118) 

Next,  combining  (112)  and  (117)  we  have 

»e(o,i/2] 

which  in  combination  with  (104)  yields 

l<e<2^^^•  (120) 


Renmrk  3.6.  In  this  remark  we  establish  an  interesting  relation  between  an  arbitrary  beO  b 
(26)  and  the  corresponding  dual  beU  6  (27)  when  (3),  (100),  (101)  and  (117)  hold. 
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Combining  (106)  and  (117)  we  have 


w(x)  <  i2(x)  <  2w(x),  (121) 

which  is  equivalent  to 

6(x)  <  b(x)  <  2b(x).  (122) 

Obviously,  the  equality  b(x)  =  b(x)  can  hold  only  for  x  such  that  6(x)  =  1,  whereas  the  equality 
b(x)  =  2b(x)  is  satisfied  only  for  x  such  that  6(x)  =  1/2,  i.e.  only  at  the  points  x  =  0  or  x  =  1. 
Finally  we  observe  that  the  last  two  relations  in  combination  with  (111)  imply  6(0)  =  6(1)  =  1. 

• 

We  solve  the  minimization  problem  (94)  (for  arbitrary  N)  under  the  constraint  (100)  only. 
It  turns  out,  however  (see  Subsection  4.3),  that  for  any  N  the  resulting  bells  also  satisfy  (3), 
(101),  amd  (102),  and  thm^fore  for  the  basis  {u*}  with  such  a  bdl  Vamd  given  by 

(118)  and  (120),  respectively  (see  Remark  3.5).  In  Appendix  we  discuss  the  solution  of  (94) 
without  any  constraints. 

Since  w  satisfies  (100),  there  exists  an  odd  function  g  such  that 

w(x)  =  (1  +  g(x))/2.  (123) 

Combining  (92),  (93),  and  (123)  we  have 

fn  =  2*/*  (^(lrM72)  Jo  ^  •  (^24) 

The  relations  (94)  and  (124)  define  the  variational  problem  for  the  computation  of  the  opti¬ 
mized  beR:  substituting  (124)  into  (94)  we  see  that  formally  it  consists  in  finding  the  absolute 
minimum  (with  respect  to  g)  of  the  functional 

Hg}^  H  /n  =  r  S  -'1  I/O  s“(«/2  +  l/4)«-  •  f  g{x)  sin(n  -I-  l/2)vxdx+ 

(125) 

»  fl/2  f\/2 

2  2_,  /  /  g(^)9iy)  •  5in(n  +  l/2))rx  •  sin(n  -f-  l/2)Tydxdy  +  C, 

where  C  is  a  fonctional  independent  of  g. 
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4.  The  Solution  of  the  Variational  Problem 


In  this  section  we  find  the  absolute  minimum  of  the  functional  /  defined  in  (125). 
4‘1.  Mathematical  Background 


Heie  we  present  a  number  of  relevant  mathematical  facts  to  be  used  in  the  next  subsection. 
The  main  result  of  this  subsection,  an  establishment  of  a  different  representation  of  the  func¬ 
tional  (125),  is  Lemma  4.3  below.  We  start  with  the  well  known  trigonometric  expansion  that 
(in  a  slightly  different  form)  can  be  found,  for  example,  in  Chap.  5  of  Tolstov  [19]. 

Lemma  4.1.  For  any  |x{  <  v, 

(2«(l*l  -  >r/2)  -  1),  (126) 

fissO 

where  -d  is  the  Heaviside  unit  step  function.  • 

The  following  lemma  is  an  immediate  consequence  of  the  formula  (126). 

Lemma  4.2.  For  any  |x|  <  1/2, 


+  V2)y(x  -  l/2)\ 
n -1-1/2  n  +  1/2  j 


naO 

Lemma  4.3.  For  any  g  €  L^([0, 1/2])  and  0  <  iV  <  oo, 

rJ/2  ,  4 

g\x)dx  -  - 

naO 


=  /  9  {x)dx  -  -  52  wo  +  l/4)ir  •  f  g{x)  sm(n  -1-  \l2)vxdx- 

Jo  ^  n+i/z  Jo 


fl/2  ,\I2 

2  zZ  /  /  9{x)g(y)  •  sin(n  -I-  l/2)7rx  •  sin(n  -f  lf2)nydxdy  +  C, 

(128) 

where  the  functional  I  is  defined  by  (125)  and  C  is  a  functional  independent  of  g. 

Prool  Throughout  the  proof  of  the  lemma  any  functional  independent  of  g  will  be  denoted 
by  C.  We  begin  with  rewriting  (125)  in  the  form 


n9)  =  h{9}-l2{9h 


(129) 
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where 


A{ff}=E/n.  (130) 

n=0 

and 

A  /^/2 

A{5}  =  S  /n  =  -  £  ••"TT/o  ®l“(”/2  +  l/4)7r  •  /  p(i)  sm(n  +  l/2)jra5di+ 
’f;^”+l/2  ./o 

(131) 

;l/2  l•l/2 

2  A/  /  /  <;(a:)5(s/)-sm(n+ l/2)Ti-sin(n+ l/2)jrydx(ii/+C. 

n=BO 

Substituting  (124)  into  (130)  we  obtain 

A{ii}  =  ES+ 

nssO 


2  ^  (-1)” 

~  2  ^TjrJ72  Jo  9ix){cos{n  +  l/2)jr(®  -  1/2)  -  cos(n  +  \/2)ic{x  +  l/2))dx  +  C, 

(132) 

where 

_  ri/2 

/„  =  2^/^  /  jr(x)sm(n+ l/2)irxd*.  (133) 

Jo 

Combining  (133)  with  Parseval’s  theorem  we  have 

oo  ri/2 

(134) 

n=0  ''® 

Next,  chan^g  the  order  of  integration  and  summation  in  the  second  sum  in  (132)  and  using 
the  formula  (127)  we  see  that  this  sum  vanishes,  which  in  combination  with  (134)  yields 

Jflf2 

i  g\x)dx  +  C.  (135) 

0 

Now  (128)  immediately  follows  from  (129),  (131),  and  (135).  • 


4.2.  The  Absolute  Minimum  of  the  Functional  I 


In  this  subsection  we  show  that  the  function  (?  :  IR  — IR.  defined  by  the  formula 

JV-l 

A'(®)  =  51  ^n8in(n+  l/2)7ri,  (136) 

nsO 
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is  the  unique  minimuiD  of  the  functional  /.  In  (136)  the  coefficients  are  the  solution  of  the 
N  X  N  linear  system 

iV-l 


^  '!  ~  ^m>  ^  —  0, 1, iV  —  1, 


(137) 


nsO 


where 


6n 


T(n/2+  1/4) 


sin(n/2  +  1/4)^, 


(138) 


and 


dntn 


1  (-ir 

2  ir(2n+l) 

sin(n  -  m)ff/2  sin(n  +  m+  1)^/2 
ir(n  — m)  ir(n+m+l) 


for  all  m  =  n. 


for  all  m  ^  n. 


(139) 


This  result  is  based  on  the  standard  analysis  of  the  first  and  second  variations  of  the  functional 


/  (see,  for  example,  Chaps.  1  and  2  of  Fox  [11]). 

Theorem  4,1.  The  function  G  defined  by  the  formulae  (1S6)  ~  (1S9)  is  an  extremal  of  the 
functional  I,  i.  e.  SI{G}  —  0 

Proof.  We  assume  that  the  functions  g  in  (128)  (and  their  variations  6g)  belong  to  I<*([0, 1/2]). 
Obviously,  the  first  variation  of  the  functional  (128)  has  the  form 


SI  =  2  /  Sg{x)  ( g(x)  ImUO  ®“(”/2  +  l/4)jr  •  sin(n  +  l/2)itx  - 

Jo  \  ir;^n+l/2 

^  yi/i  \ 

2  ^  sin(n  +  l/2)xa:  /  g(y)  •  sin(n  +  l/2)vydy  1  dx. 

n=0  / 


(140) 


The  combination  of  (140)  with  the  condition  SI{G}  =  0  yields 


<?(*)  “  f  S  +  l/4)x  •  sin(n  +  l/2)xx- 

(141) 

/■V2  \ 

2  Jo  G(y)  sin(n+  l/2)iry-sm(n+  l/2)xxj  dy  =  0, 


i.e.  any  extremal  of  J  satisfies  Fredholm's  integral  equation  of  the  second  kind  with  the  so 
called  Pincherle-Goursat  kernel  (see,  for  example.  Chap.  2  of  Tricomi  [20]).  Note,  that  now 
the  representation  (136)  is  an  immediate  consequence  of  (141). 
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The  standard  method  for  the  solution  of  the  integral  equations  with  Pincherle-Goursat 
kernels  consists  in  replacing  them  with  suitable  linear  systems  (see,  for  example,  Chap.  2  of 
Tricomi  [20]).  Substituting  (136)  into  (141)  we  obtain 


N~\ 


N-1 


£  9n sin(n  +  l/2)x®  -  7  sm{n/2  +  1/4)t  •  sin(n  +  l/2)7r 

n=0  ^  nssO  ” 

N-\  S-\  .1/2 

2  53  S"  +  l/2)xa:  /  5in(n  +  l/2)iry  •  sin(m  +  l/2)irydy  =  0. 

n=0  •'O 


x— 


(142) 


Now  using  linear  independence  of  the  functions  sin(n  +  1/2)tx  on  [0, 1/2]  and  evaluating  the 
integrals  in  (142)  we  immediately  obtain  (137)  -  (139).  • 

Theorom  4.2.  The  function  G  defined  by  (1S6)  -  (1S9)  is  the  unique  minimum  of  the  func¬ 
tional  I  . 

Proof.  Obviously,  in  order  to  prove  this  theorem  it  is  sufficient  to  show  that  for  any  nontrivial 
function  6g  (i.e  such  that  6g  ^  0  on  [0, 1/2])  the  second  variation  of  I  i  strictly  positive. 

From  (125)  we  immediately  obtain 

2 

(143) 


{ff}  =  2  53  M®)  +  l/2)7rxdxj  , 


and  thus 

>  0.  (144) 

Now  we  will  prove  that  for  any  nontrivial  Sg  the  relation  (144)  can  hold  only  as  a  strict 
inequality.  Suppose  that  there  ensts  a  nontrivial  Sg  such  that 


S^I{g}  =  0. 


(145) 


Then  combining  (143)  and  (145)  we  have 

f  Igix)  8in(n  +  l/2)ir*dx  =  0  for  all  n  =  iV,  AT  +  1, ..., 
Jo 

where  the  function  Sg  ;  [0, 1]  — » II  is  defined  by  the  formula 

f  Sg{x)  for  all  0  <  X  <  1/2, 


(146) 


Jgix)  = 


otherwise. 


(147) 
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Since  the  system  {sm(n  +  l/2)7r®}  is  complete  and  orthogonal  on  [0, 1],  the  conditions  (146) 
imply  that 

N-\ 

=  53  +  l/2)jrar,  (148) 

naO 

whme  the  coefficients  c„  are  independent  of  x.  However,  for  any  finite  N  (147)  and  (148) 
cannot  simultaneously  hold  unless  ^(®)  =  Sg(x)  =  0  for  all  x  €  [0, 1/2].  Therefore,  for  any 
nontrivial  Sg^ 

s^Hg)  >  0,  (149) 

which  concludes  the  proof  of  the  theorem.  • 

Remark  4.1.  It  immediately  follows  from  (136)  -  (139),  (123),  and  (26)  that  the  functions  w 
and  b  are  uniquely  determined  by  the  number  of  optimized  coefficients  N.  In  order  to  emphasize 
this  fact  we  will  write  ws  and  hjv  instead  of  w  and  6.  • 


4.S.  Certain  Properties  of  the  Optimized  Bells 


The  explicit  formulae  for  the  bells  found  in  the  preceding  subsection  are  obtained  by  first 
substituting  (136)  into  (123),  which  produces 


1  /  N-i  \ 

«'n(*)  =  2  +  S  9n8in(n  +  lf2)vxj  , 


(150) 


followed  by  combining  (26)  and  (150),  which  yields 


bsix)  = 


lo 


N-1  \ 

1+53  llnSin(n  +  l/2)xx  j 

for  all 

nsaO  / 

N~\  \ 

1+53  +  l/2)jrx  ) 

for  all 

nart)  / 

otherwise. 

-1/2  <  I  <  1/2, 


1/2  <  X  <  3/2, 


(151) 


In  (150)  and  (151)  the  coefficients  gn  are  the  solution  of  the  linear  system  (137)  -  (139).  The 

numerical,  values  of  these  coefficients  for  iV  <  20  are  listed  in  Table  1.  ^ 

'It  toiitt  out,  that  the  condition  nnmber  of  the  matrix  (139)  increases  rapidly  with  N,  and  in  order  to  avoid 
the  tost  of  accuracy  this  sequence  of  linear  systems  was  (numerically)  solved  in  extended  precision  arithmetics. 
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Numerical  computatiens  of  functions  bs  for  iV  <  20  via  (150)  with  p„’s  from  Table  1  show 
that  for  these  functions  the  conditions  (3),  (101),  and  (102)  are  satisfied.  Therefore  for  bases 
{tt^}  with  such  bells  the  condition  number  Teond  (42)  and  the  parameter  0  (78)  are  given  by 
(118)  and  (120),  respectively  (see  Remark  3.5).  Note  that  independently  of  N,  teond  and  6 
are  sufficiently  close  to  1  to  ensure  numerical  stability  of  the  transformations  in  bases  with  the 
optimized  bells. 

Ehcamples  of  optimized  bells  (151)  and  corresponding  dual  bells  are  shown  in  Fig.  1. 

5.  Numericsil  Results. 

In  this  section  we  compare  compression  provided  by  the  optimized  bases  with  that  obtained 
by  two  of  nonoptmtized  ones  whose  bells  are  described  in  Subsection  5.2  below.  We  also  present 
the  corresponding  results  for  the  bases  with  the  Gaussian  bells  (97). 

5.1.  Implementation  of  the  Algorithm 

The  implementation  of  the  algorithm  is  based  on  the  results  of  Subsection  2.3.  We  assume 
that  the  expanded  fimetion  /  is  defined  at  the  nodes  of  the  equally  spaced  mesh 

=  »./»,  »  =  0,±1,±2,...,  ft  =!/(/-!),  /  =  2p+l,  (152) 

where  p  >  0  is  an  integer. 

Remark  5.1.  In  most  applications  one  usually  uses  beUs  b  such  that 

6(-l/2)  =  5(3/2)  =  r,  (153) 

where  0  <  r  <  1.  In  this  paper  we  will  assume  that  r  in  (153)  is  sufficiently  small  so  that  one 
can  n^lect  the  contribution  of  the  points  x  =  k  —  lf2  and  x  =  k  +  3/2  while  (numerically) 
computmg  the  integral  in  (58)  on  the  mesh  (152).  • 

We  start  with  the  explicit  formulae  for  the  implementation  of  the  folding  (37)  and  unfolding 
(3R)  operators.  Under  the  conditions  described  in  Remark  5.1  the  folding  operator  on  the 
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interval  x  €{k  -  l/2,k+  1/2]  has  the  following  discrete  form: 


Ptim  +  Hi  - 1))  =  Mk  +  Hi  - 1))  = 

/(fc  +  H*  ~~  1))  *  w(h(i  —  1))  —  f(k  —  h(i  —  1))  •  w(—H*  —  1))  for  all  1  <  t  <  p,  (154) 


Ftim  -  Hi  - 1))  s  A-i(fc  -  Hi  - 1))  = 

f(k  +  Hi  ~  1))  •  to(-h(t  —  1))  +  f(k  —  Hi  ~  1)) '  v}(Hi  —  1))  for  all  1  <  t  <  p,  (155) 

M  =  Mk  +  hp)  =  /(fc  +  hp)  •  w{hp)  for  »■  =  p  +  1 .  (156) 

The  discretized  version  of  the  unfolding  operator  (38)  enables  us  to  obtain  the  function  /  for 
X  E  (k  —  1/2,  k+  1/2]  at  the  points  of  the  mesh  (152)  as  linear  combinations  of  functions  A 
and  A-i'  combining  (63)  with  (154)  -  (156)  we  have 

/(fc  + /»(<-!))« 

fk(k  +  Hi  -  1))  ■  w(M*  “  1))  +  -  Hi  -  1))  •  w(-M*  ”1))  for  all  1  <  »  <  p,  (157) 


fik-Hi-l))  = 

fk-\{k  -  Hi  -  1))  *  w(M*  “  1))  “  Mk  +  Hi  -  1))  •  w(-M*  ~  1))  for  all  1  <  i  <  p,  (158) 


f{k  +  hp)  =  fkik  +  hp)  •  w{hp)  for  »  =  p  +  1. 


(159) 


Next,  one  can  easily  see  from  (154)  -  (156)  that  on  the  interval  [A;,!;  +  1]  the  values  of  the 
function  fk  at  the  nodes  of  the  mesh  (152)  are  given  by 


■  /(fc  +  h(i-l)).«,(h(i-l))_ 

/(lf-h(t- l))-io(— h(»- 1))  for  all  1  <  t  <  p, 


Mk+Hi-\)) 


'  f{k  +  l  +  Hi-p~l))’w{Hp+l-i))+  (160) 

/(fc  +  ft(i  -  1))  •  to(h(/ - 1))  for  all  p  +  2<x</ 

f{k  +  ph)  •  V}{hp)  for  t  =  p  +  1. 
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Observing  that  for  any  k 


(161) 


fkik)  ==  0, 


we  obtain  the  trapezoidal  approximation  for  the  formula  (58)  in  the  form 

i 

fn  =  2*'*  •  •  E  A(*  +  M*  -  1))  •  sm(ir(n  +  1/2)  •  h  •  (t  -  1)),  n  =  0, 1, /  -  2,  (162) 

i=2 

where  the  numbers  fj^(k  +  h(t  —  1))  are  computed  in  (160). 

Conversely,  in  order  to  compute  a  function  /  on  all  the  intervals  x  6  (A;  —  1/2,  A;  +  1/2] 
(k  =s  0,±1,±2...,)  at  the  nodes  of  the  mesh  (152)  from  its  coefficients  /*“*  and  /*  one  first 
computes  the  numbers  fk-i(k  —  h(i  —  l))  with  1  <  i  <  p  and  A(A:  +  h(t  —  1))  with  1  <  t  <  p+ 1 
via  the  discretization  of  (67)  which  has  the  form 

Mk  +  k(i  -  1))  =  2'/^  2  /*  sin(z-(n  +  1/2)  •/»•(*-  1)), 

nsO 

fk^i(k  -  h(i  -  1))  =  2*/^  2  sin(x(n  +  1/2)  •  h  •  (t  -  1)),  (163) 

and  after  that  uses  the  formulae  (157)  -  (159). 

The  cost  of  the  algorithm’s  implementation  for  sufficiently  large  I  is  dominated  by  the  Fast 
Fooiier  liransform  (FFT)  in  (162)  for  forward  transform  and  the  FFT  in  (163)  for  inverse 
transform,  and  therefore  has  the  complexity  estimate  0(1  log  1). 

Now  we  wiU  discuss  the  compresaon  procedure  used  in  this  paper.  In  most  applications 
the  compresnon  of  a  function  /  in  a  certain  basis  is  usually  achieved  by  n^ecting  all  the 
coefficients  whose  absdute  values  are  smaller  than  a  given  number.  In  this  paper  on  every  A-th 


interval  we  set  to  zero  all  the  coefficients  that  do  not  satisfy  the  inequality 

/t-2  -\  '/* 


(/»)')  . 


(164) 


where  c  is  a  given  number.  The  subset  of  coeffidents  /*  that  satisfy  (164)  will  be  denoted  by 
Df.  Now  instead  of  the  exact  relations  (163)  we  have  the  approximate  formulae 

A(A?  +  h(i  -  1))  «  2'f^  53  fn  +  1/2)  •  h  •  (t  -  1)), 

n€Z>f 


A-i(A;-M*-' 53  fh  *sin(ir(n+ l/2)-/i-(t- 1)),  (165) 

n€Df"‘ 
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which  in  combination  with  (157)  -  (159)  produce  approximate  (i.e.  based  on  compressed 
expansions  (165))  values  of  /  at  the  nodes  of  the  mesh  (152).  The  arguments,  presented  in 
Subsection  3.1  (especially  in  Theorem  3.1  and  Remark  3.1)  show,  that  t  in  (164)  is  close  to  the 
rdative  error  of  this  compression  in  the  norm  (62)  provided  that  Vetnd  »  6  as  1 

FinaDy,  we  compute  the  relative  error  of  the  approximation  (165)  in  the  norm  (62).  Namely, 
replacing  the  subset  by  the  subset  in  (73)  and  observing  that  the  total  number  of 
coefficients  /*  on  the  k-th  interval  is  equal  to  /  —  1  (see  (162)),  we  have  this  error  6  in  the  form 

1/2 


f 

/nSin(n+l/2)T(af-*) 
<ntDll  > 

\ 

fn  s»n(»  +  l/2)’r(*  -  fc)j 

2 

dx 

(IM) 


5.2.  Two  Nonoptimized  Bell  Functions 


In  this  subsection  we  discuss  certain  basic  properties  of  collections  of  bells  proposed  in  [1] 
and  [7].  These  bells  are  computed  via  the  formula  (26)  in  which  w  is  replaced  by  the  functions 
ws  defined  in  (167)  and  (169)  bdow. 

The  ficdlowing  bells  were  described  by  Coifinan  [7]  and  are  based  on  the  sequence  of  functions 


Wffix) 


where 


(167) 


(168) 


Clearly,  the  functions  (167)  satisfy  the  MCM  condition  (6)  for  any  N.  The  parameter  N 
controls  the  smoothness  of  the  bell.  In  fact,  combining  (26)  and  (167)  it  is  easy  to  see  that 
for  N  >  0  the  obtained  bell  is  analytic  on  the  real  line  except  at  the  points  x  =  —1/2  and 
X  s  3/2,  where  it  has  N  continuous  derivatives,  and  at  the  point  x  =  1/2,  where  it  has  2N  +  1 
continuous  derivatives.  For  N  =  Q  the  Coifman  bell  coincides  with  the  function  ^(z)  from 
(92). 
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The  bells  proposed  by  Aharoni  et.  al.  [1]  (the  AACI  beUs)  are  based  on  functions  wsix) 
that  are  recursively  ddined  as 

*  (1  +  lto  =  sinir*,  Pn+i  =  sm(irp„/2),  n  =  0, 1, N  -  1,  (169) 

and  therefore  for  any  N  they  satisfy  the  condition  (100).  Similarly  to  (167),  the  parameter  N 
controls  the  bells*  smoothness:  one  can  verify  that  the  combination  of  (26)  and  (169)  produces 
a  fimction  that  is  analytic  on  the  real  line  except  at  the  points  x  =  —1/2  and  x  =  3/2,  where 
it  has  2^  —  1  continuous  derivatives. 

S.S.  Compression  of  Trigonometric  Functions 

In  this  subsection  we  introduce  a  number  of  parameters  estimating  the  compression  of 
trigonometric  functions  (1)  in  bases 

First,  we  consider  a  sequence  of  functions 

fj{x)  =  C08(W,X  +  Oj),  (170) 

where  j  a  1,2,...,M,  u/j  and  aj  are  random  variables  uniformly  distributed  on  [fa;i,u;2]  and 
[0,2ir],  respectively  (see  the  particular  choice  of  M,  u/i  and  in  (175)  below).  We  begin 
with  evaluating  the  expansion  coeffidents  /n(i)  of  these  functions  via  (162)  (we  again  drop 
the  superscript  for  brevity)  on  the  interval  [—1/2, 3/2]  (i.e.  for  k  =  0).  Next,  we  compute 
the  integers  mj,  equal  to  the  number  of  coefficients  that  satisfy  the  inequality  (164)  for  each 
of  the  functions  fj(x).  In  addition,  for  ev«ry  function  fj(x)  we  evaluate  the  relative  error 
of  compression  (hereafter  denoted  by  Sj)  via  (166).  Finally,  in  arrcordamce  with  the  common 
practice  (see,  for  example.  Chap.  3  of  Mandel  [15]),  we  compute  the  sample  estimates  of  the 
means  rh  and  and  thdr  standard  deviations  <r  and  os  via 

M 

m  =  Y^mjfM,  (171) 

j=i 

S^f^Sj/M,  (172) 
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and 


(M  \  ' 

^(mj  -  m)*/(A/  -  1)1  , 


(173) 

(174) 


We  wOl  also  denote  by  1h  the  number  of  coefficients  satisfying  the  inequality  (166)  for  the 
function  (91)  (formally  this  number  can  be  obtained  from  (171)  if  Wj  =  0  for  all  j).  NaturaBy, 
for  this  function  ^  =  cr  =  =  0. 

Below  we  give  the  numerical  values  of  the  parameters  and  that  were  used  in  our 

experiments: 


4/  =  100,  0/1  =  50,  1000. 


(175) 


Our  experiments  show  that  the  parameters  (171)  -  (174)  only  weakly  depend  on  Af,  u>j  and 
(t>2  provided  that  M  >  30,  ^  50,  and  (jj  > 


5.4’  The  Choice  of  the  Optimal  N 

The  bells,  defined  by  functions  (167)  and  (169),  as  weD  as  the  optimized  bells  (151),  depend 
on  a  parameter  N.  In  this  subsection  we  discuss  the  procedure  for  choosing  such  N  that  for 
the  ^ven  type  of  the  beD  and  specified  e  provides  the  best  compression  for  functions  (1)  (i.e. 
the  smallest  value  of  fii  (171)). 

In  Table  2  we  show  the  parameters  m  (171)  and  6  (172)  obtained  for  bases  with  AACI 
bdls  for  certain  values  of  N.  For  comparison  this  table  also  contains  the  corresponding  results 
for  the  function  (91)  in  the  same  bases.  As  we  see  from  Table  2,  for  any  <  there  exists  the 
optimal  chcuce  of  N  which  provides  the  best  compression  for  both  functions  (170)  and  (91). 
Our  numerical  ocperiments  show,  that  for  all  other  types  of  bells  considered  in  this  paper 
there  also  exists  the  optimal  beQ  (i.e  the  optimal  dioice  of  N  that  depends  on  c)  with  the  best 
ccnnpression  properties;  these  values  are  presented  in  Table  3. 
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5.5.  Comparison  of  Compression  in  Optimized  and  Nonoptimized  Bases 

The  main  part  of  this  subsection  is  devoted  to  the  results  of  compression  on  the  interval 
[—1/2, 3/2]  of  functions  (1)  and  (91)  in  bases  {tt*}  with  the  Coifinan  (167),  AACI  (169), 
Gaussian  (97),  and  optimized  (151)  bell  functions  for  certain  values  of  €.  The  parameters  uj, 
aj,  mj,  Oj,  m,  S,  <r,  and  as  are  defined  in  Subsection  5.3.  All  the  computations  are  performed 
with  the  optimal  (for  the  given  <  and  type  of  the  bell  function)  values  of  N  (see  Table  3).  In 
addition,  we  investigate  certain  properties  of  mcpansions  of  functions  other  than  (1)  and  (91) 
in  bases  {u*}. 

Table  4  shows  that  for  all  the  considered  examples  the  approximate  relation  (86)  is  satisfied. 
Note,  that  we  always  have  o/fh  <0.1  which  indicates  that  the  numbers  mj  only  weakly  depend 
on  aj  and  Uj  (for  sufSciently  large  uj).  Next,  the  compression  of  the  test  functions  in  bases 
with  the  Gaussian  and  optimized  bells  is  essentially  the  same,  and  it  is  substantially  better 
(especially  for  higher  accuracies)  than  that  in  bases  with  the  AACI  and  Coifinan  beUs. 

The  data  in  Table  5  are  dosdy  related  to  that  in  Table  4  and  contain  values  of  parameters 
S  (172)  and  os  (174).  These  data  show  that  for  aU  the  bells  excluding  the  Gaussian  one, 

5/f  «  1  (176) 

independently  of  c,  i.e.  in  such  cases  the  parameter  e  in  (164)  is  close  to  the  relative  error 
(in  the  norm  (62))  of  the  approximation  (165).  However,  in  the  case  of  the  Gaussian  beO  the 
ratio  i/e  increases  as  e  decreases,  which  is  a  consequence  of  the  growing  rconj  3  (see  the 
formulae  (98)  and  (99)). 

Fig.  2  shows  the  expansion  coeffidents  /„  of  the  function  (91)  in  the  four  bases,  with  the 
parameters  N  chosen  to  be  optimal  for  e  =  10~^  (see  Table  3).  Naturally,  these  dependendes 
make  sense  only  for  the  integer  values  of  the  argument,  but  for  darity  they  are  drawn  as 
continuous  functions.  As  we  see  from  Fig.  2  the  large  coeffidents  in  the  four  bases  are  dose  to 
esdh  other,  and  the  advantage  of  the  bases  with  the  Gaussian  and  the  optimized  beOs  consists 
in  generating  fewer  small  coeffidents.  Similar  behavior  of  the  expansion  coeffidents  of  the 
function  (91)  is  observed  for  other  values  of  e. 
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We  now  turn  to  the  investigation  of  the  expansions  of  functions  that  are  almost  singular  at 
one  point.  Note  that  one  cannot  improve  the  compression  of  a  function  on  a  certain  interval 
by  the  optimization  of  the  bell  if  the  function  has  an  integrable  discontinuity  on  this  interval. 

Table  6  contains  the  numbers  of  expansion  coefficients  /„  that  satisfy  the  inequality  (166) 
for  functions 

/l(*)  =  Al{x)  cos(200z),  (177) 


where 


Note,  that  for  L  =  00  the  amplitude  Ai,  coinddes  with  the  discontinuous  function 


(178) 


(179) 


naO 


which  immediately  follows  from  (1^6)  after  the  change  of  variable  x  x-^-  r/2.  The  graphs  of 
AiX^)  for  several  values  of  L  are  presented  in  Fig.  3. 

The  fdlowing  two  observations  can  be  made  from  Table  6,  that  are  typical  for  the  compres¬ 
sion  of  functions  which  are  more  complex  than  trigonometric  ones. 

1.  The  compression  in  bases  with  the  optimized  bells  is  essentially  the  same  as  in  bases 
with  the  Gaussian  bells. 

2.  For  higher  accurades  the  bases  with  the  optimized  beUs  usually  provide  a  much  better 
compression  than  the  bases  with  nonoptimized  bells.  The  advantage  of  the  optimized  bases 
becomes  more  prominent  for  smaller  £,  i.e.  when  the  amplitudes  Ai  (178)  are  less  steep  in  the 
vidnity  of  the  point  x  =  0. 

Finally,  we  discuss  the  numerical  stability  of  the  algorithm.  Although  Tables  4  and  6 
show  that  the  bases  with  the  Gaussian  and  optimized  bells  provide  similar  compression,  the 
formulae  (98)  and  (118)  indicate,  that  for  suffidently  small  e  the  optimized  bases  have  much 
smaller  condition  number.  Therefore,  in  such  cases  the  error  of  the  approximation  (165) 
will  be  larger  for  bases  with  the  Gaussian  bell  than  for  optimized  bases. 

To  iUustrate  this  phenomenon,  we  approximate  the  function 


/(*)  s=  1  +exp  (-lOz*)  cos(lOOx) 


(180) 
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OB  [—1/2, 1/2]  via  the  combination  of  (165),  where  we  keep  only  coefficients  satisfying  (164), 
with  (157)  -  (159).  Fig.  4  shows  the  difference  A  between  /  (180)  and  its  approximation  for 
(  =  10~^  in  the  bases  with  the  Gaussian  bell  and  the  optimized  bell  with  N  =  9.  One  can  see 
from  that  figure  that  while  for  the  optimized  basis  the  maximum  of  |A(z)|  is  close  to  e  for  all 
z  €  [—1/2, 1/2],  in  case  of  the  basis  with  the  Gaussian  bell  we  have  |A(z)|  (  for  certain  z 

from  the  vicinity  of  the  folding  point  a:  =  0,  i.e.  where  the  dual  beQ  is  sharply  peaked. 

6.  Conclusions  smd  Generstlizations 

In  this  paper  we  present  a  family  of  non-orthogonal  bases  that  efficiently  compress  trigono¬ 
metric  functions,  as  well  as  some  non-trigonometric  ones.  The  dual  bases  of  these  optimized 
bases  are  easy  to  construct:  any  element  of  a  dual  basis  differs  from  the  corresponding  element 
of  the  orij^al  basis  only  by  the  shape  of  the  bell.  Moreover,  the  value  of  the  condition  number 
of  these  bases  Veond  *  (2*^*  +  l)/2  «  1.2  ensures  numerical  stability  of  forward  and  inverse 
transformations  in  these  bases.  The  CPU  time  required  for  forward  and  backward  transforms 
in  the  optimized  bases  is  the  same  as  in  the  standard  MCM  scheme,  i.e.  it  is  dominated  by 
that  of  the  FFT.  The  methods  of  this  paper  can  be  easily  applied  to  the  construction  of  bases 
optimized  for  other  classes  of  functions.  This  work  is  now  in  progress  and  its  results  will  be 
reported  dsewhere. 
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Appendix:  The  Unconditional  Solution  of  (94) 

Here  we  obtadn  the  solution  of  the  minimization  problem  (94)  without  the  constraint  (100). 
Our  starting  point  is  the  formula  (92). 

Let  the  functions  be  given  by  (93)  and  suppose  that  the  function  wk  :  [-1/2, 1/2]  R 
is  defined  via  the  formula 

K-\ 

c„<^„(i),  (181) 

n=0 

where  (n  =  0, 1, K—  1)  Me  arbitrary  constants.  Observing  that  the  collection  of  functions 
(«  =  0,1,2,...)  is  an  orthogonal  basis  on  [—1/2, 1/2],  and  substituting  (181)  into  (92)  we 
have 

0 

Combining  (94)  and  (182)  we  see  that 

f;/^  =  0  forallA^iV,  (183) 

»aciV 

i.e.  any  linear  combination  (181)  with  K  <  N  provides  the  absolute  TniniTniiin  for  the  functional 
(94). 

In  an  attempt  to  construct  a  bell  function  from  (26)  and  (181)  that  satisfies  (3)  and  on 
the  real  line  has  as  many  continuous  derivatives  as  possible,  we  reqtiire  that  the  K  arbitrary 
parameters  Cn  satisfy  the  conditions 


/■1/2 

/n  =  2  /  WK{x)<}>n{x)dx  = 

J-l/2 


for  all  n  <  A  —  1, 

(182) 

otherwise. 


da:2:+i 


lx=-l/2 


=  0 


for  all  /  =  0, 1, 


K-2. 


(184) 

(185) 


Note,  that  for  any  nonn^ative  integer  K  and  n. 


<^Vn(g) 


l*=-l/2 


^^v}k{x) 


la=:-l/2 


=  0 


for  all  1  =  0,1,... . 


(186) 


It  immediately  follows  from  (185)  and  (186)  that  the  bell  function,  defined  via  (26),  (181), 
(184),  and  (185),  has  at  least  2K  —  2  continuous  derivatives  on  the  real  line.  Furthermore,  it 
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follows  from  (182)  that  in  the  basis  with  this  beU  a  constant  is  reproduced  from  its  hrst  K 
coefficients  per  interval  exactly. 

Remark  A.  It  is  worth  noting  that  the  conditions  (181),  (184)  and  (185)  in  combination  with 
(26)  do  produce  bell-shaped  functions  at  least  for  (numerically  tested  values)  K  <  10.  Graphs 
of  these  bells  for  certain  values  of  K  can  be  found  in  Fig.  5.  • 

For  example,  the  explicit  formula  for  the  bell  with  A'  =  2  is 


b2(x)  =  < 


^(3sin(T(r  -f- 1/2)/2)  —  sin(3r(ar  -t- 1/2)/2))  for  all  -1/2  <  x  <  3/2, 
0  otherwise. 


(187) 


The  bell  (187)  has  two  continuous  derivatives  on  the  real  line,  the  basis  with  such  a  bell 
reproduces  a  constant  from  its  first  two  coefficients  per  interval  exactly,  and  its  condition 
number  Vetmd  ^  1-67  is  relatively  small.  These  properties  suggest  that  the  basis  with  the  bell 
(187)  can  be  useful  in  signal  processing  where  the  required  accuracy  usually  is  not  very  high 
(normally  in  (164)  (  >  10“®),  and  where  the  low  frequency  components  of  the  signals  often 
play  an  important  role. 

However,  due  to  the  rapid  growth  of  Vcond  with  K  the  application  of  the  unconditionally 
optimized  bells  in  case  of  A*  >  2  is  limited. 


References 


[1] 

[?] 

[3] 

[4] 

[5] 

[6] 

[7] 

[8] 


[9] 

[10] 


G.  Ahwoni,  A.  Averbuch,  R.  Coifman,  and  M.  Israeli,  Local  Cosine  Traiisform  -  a  Method 
for  the  Reduction  of  the  Blocking  Effect  in  JPEG,  Journal  of  Mathematical  Imaging  and 
Vision  3  (1993),  7-38. 

B.  Alpert,  G.  Belkin,  R.  Coifman,  and  V.  Rokhlin,  Wavelet-like  Bases  for  the  Fast  Solution 
of  Second- Kind  Integral  Equations,  SIAM  J.  Sci.  Comput  14  (1993),  159-184. 

P.  Alisher,  G.  Waiss,  and  M.  V.  Wickerhauser,  Local  Sine  and  Cosine  Bases  of  Coifman 
and  Meyer  and  the  Construction  of  Smooth  Wavelets,  in  “Wavelets:  A  Tutorial  in  Theory 
and  Applications”  (C.  K.  Chui,  Ed.),  pp.  237-256,  Academic  Press,  Boston,  1992. 

G.  Belkin,  R.  Coifman,  and  V.  Rokhlin,  Fast  Wavelet  Transforms  and  Numerical  Algo¬ 
rithms,  I,  Comm.  Pure  Appl.  Math.  44  (1991),  141-183. 

B.  Bradie,  R.  Coifman,  and  A.  Grossman,  Fast  Numerical  Computations  of  Oscillatory 
Integrals  Related  to  Acoustic  Scattering,  I,  Appl.  Comput.  Harmonic  Anal.  1  (1993),  94- 
99. 


F.  X.  Canning,  Improved  Impedance  Matrix  Localization  Method,  IEEE  Trans.  Antennas 
Propagat.  41  (1993),  659-667. 

R.  R.  Coifioian,  Personal  Communication,  1991. 

R.  R.  Coifman  and  Y.  Meyer,  Remarques  sur  I’analyse  de  Fourier  a  fenetre,  C.  R.  Acad. 
Sci.  Paris  Sir.  1 312  (1991),  259-261. 

I.  Daubechies,  “Ten  Lectures  on  Wavelets”,  SIAM,  Philadelphia,  1992. 

H.  Dym  and  H.  P.  McKean,  “Fourier  Series  and  Integrals”,  Academic  Press,  Inc.,  San 
Diego,  1972. 

C.  Fox,  “An  Introduction  to  the  Calculus  of  Variations”,  Dover  Publications,  Inc.,  New 
York,  1987. 


39 


[12]  N.  S.  Jayant  and  P.  Noll,  “Digital  Coding  of  Waveforms”,  Prentice-Hall,  Englewood  Cliffs, 
NJ,  1984. 

[13]  F.  Keinert,  Biorthogonal  Wavelets  for  Fast  Matrix  Computations,  Appi  Comput.  Har¬ 
monic  Anal.  1  (1994),  147-156. 

[14]  H.  S.  Malvar,  The  Lapped  Transform  for  Efficient  Transform/ Subband  Coding,  IEEE 
Trans.  Acoust.,  Speech,  Signal  Process.  38  (1990),  969-978. 

[15]  J.  Mandd,  “The  Statistical  Analysis  of  Experimental  Data”,  Dover  Publications,  Inc., 
New  York,  1984. 

[16]  Y.  Meyer,  “Wavelets:  Algorithms  and  Applications”,  SIAM,  Philadelphia,  1993. 

[17]  K.  Rao  and  P.  Yip,  “Discrete  Cosine  Transform:  Algorithms,  Advantages,  Applications”, 
Academic  Press,  Boston,  1990. 

[18]  J.  Stoer  and  R.  BuHrsch,  “Introduction  to  Numerical  Analysis”,  Springer- Verlag,  Berlin, 
1993. 

[19]  G.  P.  Tolstov,  “Fourier  Series”,  Dover  Publications,  Inc.,  New  York,  1976. 


[20]  F.  G.  Tricomi,  “Integral  Ekiuations”,  Dover  Publications,  Inc.,  New  York,  1985. 


Table  1:  Coefficients  gn  for  the  computation  of  the  optimized  bells  (151). 


n 

N=1 

II 

N  =  S 

1 

2 

3 

1.1002143947640111085  dO 

1.1723768006269012949  dO 
0.1855148479250006034  dO 

1.2031447668472587192  dO 
0.2487749850071917170  dO 
0.0475141123801596348  dO 

n 

N=4 

II 

Ar  =  6 

1 

2 

3 

4 

5 

6 

1.2196727213232474166  dO 
0.2853161868567129887  dO 
0.0789155484618257136  dO 
0.0135550276613148530  dO 

1.2299263341780548351  dO 
0.3091936162560012950  dO 
0.1022547499107077172  dO 
0.0270080848154667718  dO 
0.0040643028367457815  dO 

1.2368960390161255733  dO 
0.3260454684070418003  dO 
0.1202144284772571658  dO 
0.0392824672307590613  dO 
0.0094646390135188831  dO 
0.0012540398189263445  dO 

n 

N=7 

N  =  8 

N  =  9 

1 

2 

3 

4 

5 

6 

7 

8 

9 

1.2419380540495429195  dO 
0.3385842628287665721  dO 
0.1344330305316184567  dO 
0.0501467090476806012  dO 
0.0153116614831942916  dO 
0.0033448841387432324  dO 
0.0003942039965801714  dO 

1.2457536263723204704  dO 
0.3482817014907560773  dO 
0.1459560151659402844  dO 
0.0596831230559218041  dO 
0.0211609941444967639  dO 
0.0059658781972807312  dO 
0.0011854380315612793  dO 
0.0001255469017738763  dO 

1.2487411472878298253  dO 
0.3560069611425606312  dO 
0.1554771240803420597  dO 
0.0680536775001451859  dO 
0.0267991398186155608  dO 
0.0088894805175620360  dO 
0.0023126782210685839  dO 
0.0004203150366958263  dO 
0.0000403732905776057  dO 

n 

N=10 

N  =  n 

N  =  12 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

1.2511435101979626018  dO 
0.3623069592485838316  dO 
0.1634729471600794903  dO 
0.0754255125823668245  dO 
0.0321305559573675648  dO 
0.0119592651970663211  dO 
0.0036995960643158676  dO 
0.0008907386396059369  dO 
0.0001489420206098608  dO 
0.0000130803773243655  dO 

1.2531171572760240244  dO 
0.3675432476836647534  dO 
0.1702809341651916143  dO 
0.0819484046917260704  dO 
0.0371207535134114532  dO 
0.0150712511279723392  dO 
0.0052752483692935777  dO 
0.0015235383929696997  dO 
0.0003408100998412218  dO 
0.0000527237866578197  dO 
0.426301975610614  d-5 

1.2547673684254528441  dO 
0.3719644997534442686  dO 
0.1761463604899294465  dO 
0.0877499693755897336  dO 
0.0417667654440872536  dO 
0.0181579310814718085  dO 
0.0069802273692443469  dO 
0.0022969056584170223  dO 
0.0006209177060710873  dO 
0.0001295783756168840  dO 
0.0000186407482263636  dO 
0.139606350016921  d-5 

n 

N=13 

N  =14 

N  =15 

1 

1.2561675816035252352  dO 

1.2573705781037171767  dO 

1.2584152648035577478  dO 

2 

0.3757474138575439717  dO 

0.3790210170105753012  dO 

0.3818817363437593838  dO 

3 

0.1812516131847340424  dO 

0.1857350426141542667  dO 

0.1897034477160271649  dO 

4 

0.0929368147130266026  dO 

0.0975974055372798749  dO 

0.1018051162625708735  dO 

5 

0.0460814756936615327  dO 

0.0500851855065012145  dO 

0.0538010556771918339  dO 

6 

0.0211765890308308775  dO 

0.0241011932143827745  dO 

0.0269168795850161325  dO 

7 

0.0087672206344614442  dO 

0.0105996145856369849  dO 

0.0124496130486740615  dO 

8 

0.0031866825949287158  dO 

0.0041695173336949991  dO 

0.0052243034619146703  dO 

9 

0.0009873442127753202  dO 

0.0014340335627767149  dO 

0.0019527481969350935  dO 

10 

0.0002505909631277034  dO 

0.0004193026849064740  dO 

0.0006365376324034804  dO 

11 

0.0000489789669579668  dO 

0.0001002259697370695  dO 

0.0001760791467702309  dO 

12 

0.658213072318501  d-5 

0.0000184143983824276  dO 

0.0000397571893420880  dO 

13 

0.459014688967825  d-6 

0.232126216952405  d-5 

0.688941970620248  d-5 

14 

15 

0.151428882710068  d-6 

0.817633371026949  d-6 
0.501000810832705  d-7 

n 

N=16 

II 

=  18 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 

17 

18 

1.2593309500457438031  dO 
0.3844030891706786254  dO 
0.1932405574881542732  dO 
0.1056209666415645249  dO 
0.0572526660933526002  dO 
0.0296162216589041811  dO 
0.0142964336695234923  dO 
0.0063326892901278450  dO 
0.0025343672760701497  dO 
0.0009011351818553216  dO 
0.0002789521059156221  dO 
0.0000731823780789826  dO 
0.0000156526972929684  dO 
0.256611058982070  d-5 
0.287672400786250  d-6 
0.166167484200405  d-7 

1.2601401306174552497  dO 
0.3866421087683765354  dO 
0.1964129247635806935  dO 
0.1090959178203754145  dO 
0.0604627480475656409  dO 
0.0321967100439478970  dO 
0.0161247652829157535  dO 
0.0074791070877270307  dO 
0.0031697006503196943  dO 
0.0012105885859207094  dO 
0.0004101047807666002  dO 
0.0001208077758892354  dO 
0.0000301301370711848  dO 
0.612055142365566  d-5 
0.951935962296931  d-6 
0.101105205879303  d-6 
0.552324489986036  d-8 

1.2608603612954268205  dO 
0.3886437212387816550  dO 
0.1992741058079349344  dO 
0.1122727446284484620  dO 
0.0634525707675491656  dO 
0.0346590468664805595  dO 
0.0179235156823607947  dO 
0.0086505731134735900  dO 
0.0038499687030354075  dO 
0.0015615520391816049  dO 
0.0005698390644760264  dO 
0.0001842373381822920  dO 
0.0000517518322815702  dO 
0.0000122981314895988  dO 
0.237837400561446  d-5 
0.351830571000310  d-6 
0.354989120817137  d-7 
0.183937626456071  d-8 

n 

N:rl9 

iV  =  20 

1 

1.2615055408626026438  dO 

1.2620868165186817100  dO 

2 

0.3904437975327983132  dO 

0.3920713262058702161  dO 

3 

0.2018676789041392205  dO 

0.2042294606490294914  dO 

4 

0.1151875431220117202  dO 

0.1178709389362636122  dO 

5 

0.0662416923898752204  dO 

0.0688479112856821096  dO 

6 

0.0370059895821450853  dO 

0.0392415664712484188  dO 

7 

0.0196848223338375282  dO 

0.0214032823468272275  dO 

8 

0.0098363945921014495  dO 

0.011027855040%93667  dO 

9 

0.0045670612090700171  dO 

0.0053136548560657154  dO 

10 

0.0019502209236860229  dO 

0.0023726050667205839  dO 

11 

0.0007577056719391676  dO 

0.0009726951425515420  dO 

12 

0.0002645671093113601  dO 

0.0003624288874381589  dO 

13 

0.0000817808996953258  dO 

0.0001212704239660943  dO 

14 

0.0000219482849485672  dO 

0.0000359012169826721  dO 

15 

0.498006589408313  d-5 

0.922285969549705  d-5 

16 

0.918946754735698  d-6 

0.200203409841185  d-5 

17 

0.129595480966266  d-6 

0.353205918170597  d-6 

18 

0.124523708171851  d-7 

0.475881033651720  d-7 

19 

0.613594334772978  d-9 

0.436427442377405  d-8 

20 

0.204997258761082  d-9 

Table  2:  Compression  of  functions  (91)  (I)  and  (1)  (U)  in  bases  {tt^}  with  AACI  bells  for 


certain  values  of  N. 


Ikble  3:  The  optimal  parameters  N  for  certain  values  of  e 


Type 

of 

bell 

AACI 

Coifinan 

Optimized 

WEM 

2 

4 

jUI 

mm 

7 

9 

E5I  DSi 

mM 

13 

16 

Table  4:  Comparison  of  compression  of  functions  (91)  (1)  and  (1)  (11).  For  each  value  of  e 

the  choice  of  N  is  the  same  as  in  Table  3. 


Type 

of 

bell 

AACI 

Coifinan 

Gaussian 

Optimized 

a 

r- s— 

a 

1 - ^ - 

D 

D 

fh 

D 

I 

wm 

rx 

n 

ri 

n 

1 

n 

■QjSH 

5 

9.7 

mi 

9.7 

Wil 

B 

imi 

4 

mgm 

0.7 

KB 

17 

33.3 

33.8 

M 

m 

9 

Iffl 

1.3 

BS9 

48 

92.2 

81.3 

m 

HI 

ISI 

16 

37.8 

3.2 

Table  5:  The  sample  mean  error  S  (172)  and  standard  deviation  as  (174)  (see  text  for 
details).  For  each  value  of  c  the  choice  of  N  is  the  same  as  in  Table  3. 


Type 

of 

beU 

AAa 

Coifinan 

Gaussian 

Optimized 

n 

as/( 

S/, 

as/( 

S/e 

<fs/( 

6/e 

as/e 

■TjBfl 

Bli 

1.1 

0.8 

0.5 

0.3 

IfB 

0.9 

1.1 

3.5 

2.0 

■ila 

0.3 

BSS 

1.3 

■39 

1.0 

la 

60 

41 

1.2 

0.3 

44 


‘Eftble  6;  Compression  the  function  fi  (177)  for  I  =  2  (I),  L  =  4  (11),  L  =  8  (III),  and 
16  (rV).  For  each  value  of  c  the  choice  of  N  is  the  same  as  in  Table  3. 


¥ 


tc 

r:‘ 

r 


Type 

of 

bell 

AACI 

Coifinan 

Gaussian 

Optimized 

< 

I 

n 

m 

IV 

I 

n 

m 

IV 

I 

n 

m 

IV 

I 

n 

m 

IV 

wjSII 

9 

11 

13 

23 

12 

12 

16 

25 

10 

la 

25 

8 

m 

13 

23 

!^Bi 

33 

30 

36 

45 

35 

36 

41 

49 

22 

mTm 

37 

20 

27 

38 

95 

93 

95 

102 

85 

84 

88 

96 

38 

Q 

Q 

55 

39 

m 

44 

54 

45 


